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VALUE  COST  MANAGEMENT 
REPORT  TO  EVALUATE 
THE  CONTRACTOR'S  ESTIMATE 
AT  COMPLETION 

DavidS.  Christensen,  Ph.D. 


The  earned  value  cost  management  report  is  a  valuable  management  tool 
for  project  managers.  Its  long  association  with  earned  value  management 
systems  criteria  (formerly  cost/schedule  control  systems  criteria)  and  the 
related  technical  jargon,  however,  may  have  caused  some  project  managers 
to  ignore  the  information  that  it  can  provide  about  the  future  performance  of 
their  projects.  This  article  is  a  brief  tutorial  for  project  managers  and  others 
interested  in  using  the  report  more  effectively.  Actual  performance  data  from 
a  failed  project  and  important  research  results  are  used  to  describe  three 
simple  analysis  techniques  for  evaluating  the  contractor's  projected  final  cost 
of  a  project,  termed  the  estimate  at  completion. 


For  more  than  three  decades,  the  De¬ 
partment  of  Defense  (DoD)  has  re¬ 
quired  defense  contractors  to  report 
detailed  information  about  the  cost  and 
schedule  status  of  a  defense  contract  on  a 
monthly  cost  management  report,  known 
as  the  cost  performance  report  (CPR)  or 
the  cost/schedule  status  report  (C/SSR). 
Earned  value,  or  the  budgeted  cost  of  work 
performed,  is  a  key  performance  metric 
on  the  report.1  It  is  the  basis  for  determin¬ 
ing  cost  and  schedule  variances,  and  is 
often  used  as  part  of  a  formula  to  help 
estimate  the  final  cost  of  the  contract, 
termed  the  estimate  at  completion  (EAC). 


To  assure  the  reliability  of  the  CPR, 
defense  contractors  were  also  required  to 
comply  with  generic  management  stan¬ 
dards  known  as  cost/schedule  control  sys¬ 
tems  criteria  (C/SCSC).  Although  the 
management  standards  or  criteria  were 
sound,  policies  related  to  implementing 
them  grew  to  become  an  administrative 
burden  for  the  government  and  the  con¬ 
tractor  (Coopers  andLybrand,  1994;  Gen¬ 
eral  Accounting  Office,  1997).  In  addition, 
C/SCSC  compliance  reviews  were  typi¬ 
cally  managed  by  financial  personnel  and 
conducted  like  audits.  As  a  result,  the 
project  manager  often  perceived  the  CPR 
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as  a  financial  rather  than  a  management 
report,  and  did  not  use  it  as  effectively  as 
possible  (Abba,  1995). 

Recently,  the  implementation  polices 
were  revised  to  foster  more  cooperation 
between  the  government  and  the  contrac¬ 
tor  and  to  establish  the  CPR  as  a  manage¬ 
ment  report.  Overall  responsibility  for 
earned  value  management  was  moved 
from  finance  to  project  management  in 
1989.  In  1996,  the  criteria  were  revised 
by  industry,  accepted  by  the  government, 
and  re-named  earned  value  management 
systems  (EVMS)  criteria. 

The  basic  concept  of  earned  value 
management  has  not  changed  since  its 
inception  since  1967.  In  addition,  the  con¬ 
tent  of  the  cost  management  report  has  not 
changed,  possibly  because  its  value  as  a 
project  management  tool  is  widely 
recognized  (Little,  1983  and  1984;  DoD 
IG  Audit  Report,  1993;  Office  of  Man¬ 
agement  and 
Budget,  1997; 
GAO,  1997). 
This  article  de¬ 
scribes  the  ba¬ 
sic  data  pro¬ 
vided  in  the  re¬ 
port  and  identi¬ 
fies  a  few  tech¬ 
niques  for  con¬ 
verting  the  data  into  information  useful 
to  contract  managers,  project  managers, 
and  others  involved  in  managing  a  major 
project.  In  particular,  three  ways  to 
evaluate  the  reasonableness  of  the 
contractor’s  EAC  are  described.  Two  of 
these  involve  comparing  the  project’s 
cumulative  cost  performance  with  its 
predicted  future  performance.  The  other 
technique  involves  comparing  a  range  of 
estimates  found  to  be  accurate  on  a  large 


"The  effect  of 
a  manufacturer's 
changes  to  aviation 
COTS  can  be  boiled 
down  to  two  specific 
cEffiaJtiest  airwor¬ 
thiness  and  forced 
mcxfifi  cations." 


number  of  completed  projects  with  the 
predicted  final  cost  of  the  ongoing  project. 

Although  the  example  is  taken  from  a 
large,  criteria-consistent  defense  contract, 
the  basic  analysis  techniques  described  in 
this  article  apply  to  projects  of  any  size, 
government  or  commercial.  Versions  of 
the  DoD’s  EVMS  criteria  have  been  used 
for  many  years  by  nondefense  agencies, 
including  the  Department  of  Transporta¬ 
tion,  Department  of  Energy,  and  National 
Aeronautics  and  Space  Administration.  In 
recent  years,  earned  value  management 
systems  and  the  resulting  data  from  those 
systems  have  been  used  to  manage  com¬ 
mercial  projects  in  the  United  States  and 
abroad  (Abba,  1995). 


The  Terminology  of  Earned 
Value  Management  Reports 


Terminology  used  in  earned  value  man¬ 
agement  reports  can  be  confusing.  The 
acronyms  alone  number  in  the  dozens. 
Regardless  of  the  kind  of  project  (defense, 
space,  construction,  etc.),  however,  only 
three  basic  data  elements  listed  on  the 
earned  value  management  report  are  cen¬ 
tral  to  proper  planning,  measurement,  and 
analysis:  budgeted  cost  for  work  sched¬ 
uled  (BCWS),  budgeted  cost  for  work 
performed  (BCWP),  and  actual  cost  of 
work  performed  (ACWP).  Nearly  all  of 
the  other  data  items  may  be  derived  from 
them. 

The  BCWS  is  the  budget  for  work 
scheduled  to  be  completed.  It  can  be  either 
monthly  or  cumulative.  As  a  monthly 
amount,  it  represents  the  amount  of 
work  scheduled  to  be  completed  for  that 
month.  As  a  cumulative  amount,  it  rep¬ 
resents  the  amount  of  work  scheduled  to 
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be  completed  to  date.  BCWS  is  also 
known  as  “planned  value.” 

The  BCWP  is  the  budget  for  the  com¬ 
pleted  work.  It  also  can  be  either  monthly 
or  cumulative.  Monthly  BCWP  represents 
the  amount  of  work  completed  during  a 
month;  cumulative  BCWP  represents  the 
amount  of  work  completed  to  date.  BCWP 
is  also  known  as  “earned  value.” 

The  ACWP  is  the  actual  cost  incurred 
in  accomplishing  the  work  within  a  given 
period.  Like  the  budgets,  both  direct  and 
indirect  costs  are  included.2  To  permit 
meaningful  comparisons,  the  ACWP 
should  be  recorded  in  the  same  time  period 
as  BCWP  for  a  given  piece  of  work. 

At  the  start  of  a  project,  work  is  typi¬ 
cally  categorized  into  near-term  and  far- 
term  effort.  The  near-term  effort  is  divided 
into  manageable  pieces  known  as  work 
packages.  On  a  large  project,  there  may 


be  more  than  100,000  work  packages  that 
must  be  performed  before  the  project  is 
completed.  As  a  result,  only  the  near-term 
work  is  planned  in  detail.  The  remaining 
work  is  known  as  planning  packages.  As 
the  project  progresses,  the  planning  pack¬ 
ages  are  systematically  divided  into  work 
packages  and  planned  in  detail. 

Regardless  of  the  timing  of  the  work,  a 
budget  in  terms  of  hours,  dollars,  or  other 
measurable  units  is  assigned  to  each  work 
and  planning  package.  By  summing  their 
budgets,  a  time-phased  budgetary  baseline 
for  the  entire  project  is  defined.  This 
baseline,  known  as  the  performance  mea¬ 
surement  baseline  (PMB),  represents  the 
standard  or  plan  against  which  the  perfor¬ 
mance  (BCWP)  and  the  cost  (ACWP)  of 
the  project  are  compared. 

Figures  1  and  2  illustrate  the  typical  con¬ 
dition  of  many  projects:  behind  schedule 


Estimated  final  cost 


Figu’e  1. 

Performance  Measurement  Baseline  (Without  Technical  Jargon) 
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Figure  2. 

Performance  Measurement  Baseline  (With  Technical  Jargon) 


and  over  budget.  Figure  1  uses  nontech¬ 
nical  jargon.  Figure  2  uses  the  technical 
jargon  just  described.  The  PMB  represents 
the  plan.  Because  less  work  has  been  com¬ 
pleted  (in  terms  of  dollar  value)  than  was 
planned  to  be  completed  at  this  point,  a 
schedule  slippage  (adverse  schedule 
variance)  is  identified.  Similarly,  because 
actual  costs  exceed  the  budget  for  the  com¬ 
pleted  work,  an  unfavorable  cost  variance 
is  identified. 

The  figures  also  illustrate  a  third  vari¬ 
ance.  The  variance  at  completion  (VAC) 
is  the  difference  between  the  total  budget 
of  the  project,  termed  the  budget  at 
completion  (BAC),  and  the  estimated 
total  cost  of  the  project,  termed  the  esti¬ 
mate  at  completion  (EAC).  In  this  case, 
an  adverse  VAC  (estimated  final  overrun) 
is  indicated. 


When  these  variances  are  judged  sig¬ 
nificant  they  are  immediately  investigated 
by  managers  who  are  empowered  to  take 
appropriate  corrective  action.3  The  cost 
management  report  summarizes  the 
monthly  cost  and  schedule  status  of  the 
project  by  listing  the  three  data  elements, 
the  related  variances,  the  BAC,  and  the 
revised  EAC  for  all  of  the  major  pieces  of 
work  on  the  project. 

The  report  also  describes  the  causes  of 
the  variances  and  the  corrective  action 
plans  related  to  the  variances.  Typical 
causes  of  variances  include  poor  initial 
planning  or  budgeting,  changes  to  the 
project’s  scope,  changes  in  technology 
related  to  the  project,  changes  to  the  delivery 
schedule,  changes  to  labor  contracts, 
changes  to  material  costs,  inflation,  and 
measurement  error.  Inaccurate  indirect 
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cost  allocations  can  also  contribute  to  cost 
variances  reported  on  defense  contracts. 
The  project’s  PMB  includes  indirect  cost 
as  well  as  direct  cost.  In  addition,  ACWP 
includes  indirect  costs,  and  defense  con¬ 
tractors  must  investigate  all  significant 
cost  variances,  including  indirect  cost 
variances.  The  Defense  Contract  Audit 
Agency  (DCAA)  is  usually  given  the 
responsibility  for  ensuring  that  the 
contractor’s  indirect  cost  management 
systems  are  in  compliance  with  the 
criteria.4 

Eventually,  summarized  portions  of  the 
cost  management  report  reach  the  Office 
of  the  Secretary  of  Defense  (OSD)  and 
Congress,  where  they  may  be  used  to  help 
determine  the  continued  funding  of  the 
project.5  Only  rarely  has  a  large  cost  over¬ 
run  on  a  defense  contract  resulted  in  the 
project’s  cancellation.  However,  Congres¬ 
sional  oversight,  the  threat  to  cancel  fund¬ 
ing,  and  the  budget  discipline  required  by 
the  criteria  may  have  limited  cost  growth 
on  defense  projects.  Although  the  average 
cost  overrun  on  defense  contracts  has 
averaged  about  20  percent  since  the  mid- 
1960s,  cost  overruns  on  some  nondefense 
projects  of  comparable  size  and  complex¬ 
ity  have  been  larger  (Drezner,  Jarvaise, 
Hess,  Hugh,  and  Norton,  1993,  p.  xiv). 

Evaluating  the  Contractor's 
Estimate  at  Completion 


From  the  contractor’s  and  the  govern¬ 
ment’s  perspectives,  the  contractor’s  EAC 
is  one  of  the  more  critical  numbers  on  the 
cost  management  report.  The  contractor 
is  required  to  advise  the  government  of 
potential  significant  overruns  or  under¬ 
runs.  In  some  cases  the  EAC  is  used  to 


adjust  progress  payments  (DCAA,  1996, 
paras.  11-207,  14-205).  Deficiencies  in 
determining  or  revising  the  EAC  may  sig¬ 
nificantly  affect  forward  pricing  propos¬ 
als,  billing  requests,  and  the  reliability  of 
the  VAC  as  a  control  variance  (Dahlberg, 
Colantuono,  and  Fischer,  1992,  p.  9). 

Given  its  importance,  the  EAC  is  peri¬ 
odically  revised  by  the  contractor  and 
closely  monitored  by  the  government. 
Contractors  periodically  develop  “compre¬ 
hensive”  EACs  by  estimating  and  aggre¬ 
gating  the  costs  of  incomplete  work  and 
planning  pack¬ 
ages  remaining  «Given  its 

on  the  contract.6  importances  the 

In  addition,  the  EAC  is  pericxfically 

contractor’s  revised  by  the  aon- 

EAC  is  exam-  fractor  and  closely 

ined  monthly  monitored  by  the 

for  accuracy  government" 

and  revised  as 

necessary  to  ensure  that  resource  require¬ 
ments  are  realistic  and  properly  phased 
(DoD,  1996,  para.  3-6e).  Whenever  the 
EAC  is  changed,  the  contractor  should 
explain  the  rationale  in  the  cost  manage¬ 
ment  report  that  is  sent  to  the  government. 
Frequent  revisions  of  the  EAC  are  not 
necessarily  considered  evidence  of  its 
unreliability.  On  a  multiyear  defense  pro¬ 
ject,  an  unchanging  EAC  would  be 
suspicious. 

Despite  the  discipline  required  by  the 
criteria,  a  RAND  study  recently  concluded 
that  EACs  have  been  systematically 
understated  for  more  than  20  years 
(Drezner  et  al.,  1993).  Because  a  system¬ 
atic  bias  in  the  EAC  can  adversely  affect 
the  resource  allocation  decisions  made  by 
Congress  and  eventually  the  effectiveness 
of  defense  policy,  it  is  important  to  know 
how  to  identify  an  understated  EAC.  The 
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The  IK-12. 


remainder  of  this  article  describes  three 
simple  analysis  techniques  that  may  be 
useful  in  evaluating  the  accuracy  of  the 
contractor’s  EAC.  Cost  performance  data 
from  the  Navy’s  A-12  program  is  used  to 
illustrate  the  techniques.7 

The  A-12  was  the  Navy’s  premier  avia¬ 
tion  project.  In  January  1991,  Secretary 
of  Defense  Richard  Cheney  canceled  the 
project,  complaining  that  no  one  could  tell 
him  what  the  final  cost  of  the  project 
would  be.  In  fact,  there  were  many  EACs, 
some  more  credible  than  others.  Unfortu¬ 
nately,  the  more  credible  EACs  were  not 
reported  on  the  CPR  or  the  summary 
reports  sent  to  the  Office  of  the  Secretary 
of  Defense.8  A  Navy  investigation  of  the 


A-12  cancellation  revealed  that  adverse 
information  about  the  A-12  may  have 
been  suppressed  by  the  Navy  Program 
Office.  The  Navy’s  “inquiry  officer”  on 
the  cancellation  of  the  A-12  program,  C. 
P.  Beach,  Jr.,  concluded  that  schedule  and 
cost  goals  for  the  A-12  were  too  optimis¬ 
tic  and  should  not  have  been  supported 
by  government  managers  in  the  contract 
and  program  offices  (Beach,  1990,  p.  39- 
41).  Table  1  shows  the  April  1990  cost 
performance  data  for  the  A-12,  six  months 
before  the  project  was  canceled. 

To  evaluate  the  reasonableness  of  the 
contractor’s  EAC,  three  comparisons 
should  be  made.  First,  the  overrun  to  date 
(cost  variance,  CV)  should  be  compared 


Table  1. 

dost  Performance  Data  for  A-12  Project 
(April  199Q  Millions  of  Dollars) 


BCWP 

ACWP 

April 

'  2,080 

1,491 

1,950 

(589) 

(459) 

4,046 

4,400 

(354) 
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to  the  estimated  final  overrun  (VAC).  If 
the  overrun  to  date  is  worse  than  the 
estimated  final  overrun,  the  contractor  is 
predicting  a  recovery.  Thus,  in  April  1990 
the  A-12  contractors  predicted  a  recovery 
of  $105  million  ($459  million  to  $354  mil¬ 
lion).  Recoveries  from  cost  overruns  on 
defense  contracts  are  extremely  rare,  es¬ 
pecially  when  the  project  is  more  than  20 
percent  completed.  In  this  case,  the  project 
is  about  37  percent  complete  (BCWPcum/ 
BAC).  Analysts  should  have  been 
extremely  dubious  about  the  ability  of  the 
A-12  project  to  finish  at  $4.4  million.  The 
report  on  the  A-12  cancellation  indicated 
that  the  Navy  cost  analyst  who  was  re¬ 
sponsible  for  analysis  of  the  A-12  CPR 
briefed  higher,  more  realistic  EACs  to  the 
Navy  Program  Office.  But  the  program 
manager  chose  to  rely  on  a  lower,  more 
optimistic  EAC  and  reported  it  to  higher 
level  decision  makers  as  the  “most  likely” 
EAC  (Beach,  1990,  p.  13). 

The  second  comparison  uses  two  per¬ 
formance  indices:  the  cost  performance 
index  (CPI)  and  the  to-complete  perfor¬ 
mance  index  (TCPI).  As  Equation  1 
shows,  the  CPI  measures  the  budgeted  cost 
of  completed  work  against  the  actual  cost. 
If  the  CPI  is  less  than  one,  an  unfavorable 
cost  variance  is  indicated.  In  this  case,  the 
CPI  is  0.76  (1491  /  1950),  which  means 
that  for  every  dollar  spent,  $0.76  of  work 
has  been  completed. 

CPI  =  BCWP  /  ACWP  (1) 

As  shown  in  Equation  2,  the  TCPI 
measures  the  budget  for  the  remaining 
work  (BAC-BCWPcum)  against  the 
estimated  cost  to  achieve  the  EAC  (EAC 
-  ACWPcum).  In  this  case,  the  TCPI  is 
1.04,  indicating  $1.04  of  work  to  be 


completed  for  every  dollar  spent.  Research 
on  completed  defense  contracts  shows  that 
the  cumulative  CPI  does  not  change  by 
more  than  10  percent  from  its  value  at  the 
20  percent  completion  point,  and  in  most 
cases  only  worsens  (Christensen  and 
Heise,  1993).  Thus,  when  the  cumulative 
CPI  is  significantly  less  than  the  TCPI,  it 
is  highly  doubtful  that  the  contract  will 
be  completed  at  the  EAC.  In  the  A-12 
case,  this  simple  comparison  indicates  that 
the  EAC  was  too  small.  More  realistic 
EACs  could  have  been  computed  using 
the  simple  formula  shown  in  Equation  3. 

TCPI  =  (BAC  -  BCWPcum)  /  (EAC  -  ACWPcum) 
(2) 

EAC  =  ACWPcum  +  (BAC  -  BCWPcum)  / 
Performance  factor  (3) 

The  final  comparison  involves  gener¬ 
ating  a  range  of  “independent”  EACs  using 
the  generic  formula  shown  in  Equation  3. 
Figure  1  illustrates  that  the  EAC  can  be 
estimated  by  extrapolating  ACWPcum  to 
the  end  of  the  project.  More  specifically, 
Equation  3  indicates  that  ACWPcum  is 
extrapolated  by  simply  adding  ACWPcum 
to  the  budget  for  the  remaining  work  (BAC 
-  BCWPcum),  adjusted  by  applying  a 
performance  factor.  The  performance  fac¬ 
tor  may  reflect  the  analyst’s  expectations 
about  the  future  performance  on  the  con¬ 
tract.  Using  data  from  hundreds  of  com¬ 
pleted  defense  contracts,  researchers  have 
concluded  that  past  performance  on 
defense  contracts  is  predictive  of  the  future 
(Christensen  and  Heise,  1993;  Drezner  et 
al.,  1993).9  Hence,  the  performance  factor 
used  in  Equation  3  is  often  either  the  CPI, 
the  schedule  performance  index  (SPI),  or 
some  combination  of  the  two  indices. 
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Table  2. 

A  Range  of  Estimates  at  Garrpletian  for  the  A-1 2 
(Derived  from  the  (Xmiative  Performance  Data  in  Table  1) 


Performance  factor 

Performance  factor  value 

EAC  (Millions) 

CPI  x  SPI 

0.5481 

$6,612 

SPI 

0.7168 

$  5,514 

.8  CPI  x  .2  SPI 

0.7551 

$5,334 

CPI 

0.7646 

$  5,292 

Equation  4  shows  the  formula  for  the 
SPI.  An  SPI  that  is  less  than  one  indicates 
an  unfavorable  schedule  variance.10  In  the 
A-12  case,  the  SPI  is  0.72,  indicating  that 
for  every  dollar  of  work  scheduled  to  be 
accomplished,  only  $0.72  was  accom¬ 
plished.  In  other  words,  the  contract  was 
behind  schedule  as  well  as  over  budget. 
Because  scheduling  problems  often 
require  additional  funding  to  correct,  an 
unfavorable  SPI  may  be  predictive  of 
future  cost  overruns  (Christensen, 
Antolini,  and  McKinney,  1995). 

SPI  =  BCWP  /  BCWS  (4) 

Table  2  shows  four  popular  perfor¬ 
mance  factors  (CPI,  SPI,  0.8  CPI  +  0.2 
SPI,  CPI  x  SPI)  and  the  resulting  EACs 
using  the  A-12  data.11  If  this  range  of 
EACs  is  considered  reasonable,  the  $4,400 
million  EAC  reported  by  the  contractors 
is  clearly  understated.  Note  that  the  small¬ 
est  and  largest  EACs  were  derived  from 
the  CPI  and  the  product  of  CPI  and  SPI, 
respectively.  This  is  expected.  Research 
has  shown  that  the  EAC  derived  from  the 
CPI  is  a  reasonable  floor  to  the  final  cost 


(Christensen,  1996).  Also,  the  EAC  based 
on  the  product  of  CPI  and  SPI  is  usually 
quite  large  because,  historically,  most 
defense  contracts  finish  behind  schedule 
and  over  budget  (Christensen,  1994; 
Drezner  et  al.,  1993).  When  a  contract  is 
behind  schedule  and  over  budget,  the  SPI 
and  the  CPI  are  each  less  than  one.  On 
April  1990,  the  SPI  and  CPI  of  the  A-12 
were  0.7168  (=1491  /  2080)  and  0.7646 
(=1491  /  1950),  respectively.  When  these 
two  performance  indices  are  multiplied 
together,  the  product  is  less  than  either 
index  by  itself  (0.7168  x  0.7647  =  0.5481), 
and  the  resulting  EAC  is  very  large. 

Conclusion 


The  use  of  earned  value  is  accelerating 
worldwide.  Although  it  began  in  industry, 
it  was  developed  and  used  primarily  on 
U.S.  defense  contracts.  The  association 
with  the  DoD’s  cost/schedule  control 
systems  criteria  may  have  created  a  mis¬ 
conception  that  earned  value  is  inappro¬ 
priate  for  smaller,  nongovernment 
projects.  But  earned  value  and  the  related 
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cost  management  reports  can  be  used  with¬ 
out  the  criteria  on  projects  of  any  size.  On 
large  government  projects,  where  the  risk 
of  cost  growth  is  often  carried  by  the 
government,  the  planning  and  control 
discipline  fostered  by  the  criteria  is  essen¬ 
tial.  On  other  kinds  of  projects,  a  full-scale 
application  of  the  criteria  is  not  necessary 
(Fleming  and  Koppelman,  1996).  As  a 
result,  other  U.S.  government  agencies, 
governments  of  other  countries,  and 
companies  across  the  world  have  accepted 
earned  value  as  an  effective  project 
management  tool  (Abba,  1995, 1997). 


The  simple  analysis  methods  described 
here  illustrate  one  beneficial  use  of  earned 
value  data:  evaluating  the  reasonableness 
of  the  contractor’s  EAC.  Although  the 
acronyms  and  technical  jargon  used  in 
project  management  can  be  confusing,  the 
cost  management  report  prepared  from 
earned  value  data  can  provide  project 
managers  with  valuable  insight  into  the 
cost  and  schedule  status  of  their  project. 
When  used  properly,  the  variances  and 
performance  indices  can  help  a  manager 
focus  attention  on  emerging  problems.  The 
cost  management  report  is  not  a  financial 
report.  It’s  a  tool  for  project  managers. 
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Endnotes 


1 .  More  formally,  earned  value  is  defined 
as  “the  value  of  completed  work  ex¬ 
pressed  in  terms  of  the  budget  as¬ 
signed  to  that  work”  (DoD,  1996,  p. 
63). 

2.  Indirect  cost  may  not  be  allocated  to 
the  detailed  levels  of  the  work  (e.g., 
control  accounts  and  work  packages). 

3.  Historically,  a  significant  variance  was 
one  that  exceeded  a  prespecified  limit 
(e.g.,  percentage  of  the  budget,  or  a 
dollar  amount,  or  both).  When  applied 
arbitrarily  to  all  levels  of  work  on  the 
contract,  it  can  result  in  excessive 
analysis  and  reporting.  Recently,  defi¬ 
nitions  of  significance  have  been 
modified  to  reduce  the  number  of 
frivolous  variance  investigations  and 
reports. 

4.  Presently,  there  is  no  requirement  that 
promising  cost  assignment  methods 
like  activity-based  costing  (ABC)  be 
used.  But  the  criteria  are  not  incom¬ 
patible  with  ABC,  and  DCAA  is  not 
blocking  defense  contractors  from 
adopting  it  (Oyer,  1992). 

5 .  Cost  management  data  on  Acquisition 
Category  I  (ACAT  I)  programs  are 
routinely  summarized  by  program 
offices  and  sent  to  the  Office  of  the 
Secretary  of  Defense  for  inclusion  in 
the  Defense  Acquisition  Executive 
Summary  (DAES)  data  base.  In  addi¬ 
tion,  selected  data  from  the  CPR  are 
included  in  a  comprehensive  annual 
report  of  ACAT  I  programs  to  Congress. 


6.  The  criteria  do  not  specify  how  fre¬ 
quently  the  comprehensive  EAC 
should  be  developed.  The  Earned 
Value  Management  Implementation 
Guide  (DoD,  1996)  recommends  that 
the  comprehensive  EAC  be  developed 
“periodically”  at  the  control  account 
level  (para  3-6e). 

7 .  Each  of  the  Services  has  had  programs 
with  severe  cost  and  schedule  prob¬ 
lems.  According  to  Abba  (1995,  p.  1), 
“Cost  problems  on  the  Army’s 
AAWS-M  (Javeline)  and  the  Air 
Force’s  C-17  were  all  shown  to  be 
foreseeable,  if  not  avoidable,  using 
earned  value  reports  from  the  contrac¬ 
tors’  C/SCSC  management  control 
systems.” 

8.  The  special  access  nature  of  the  pro¬ 
gram  interfered  with  higher  level  over¬ 
sight  of  the  A-12’s  cost  performance. 
For  example,  the  cost  management 
staff  at  the  Office  of  the  Secretary  of 
Defense  (OSD)  was  not  cleared  for  ac¬ 
cess  to  the  data  until  March  1990. 
Adverse  cost  and  schedule  variances 
that  would  have  normally  prompted 
investigations  by  OSD  were  delayed 
by  more  than  a  year  (Beach,  1990, 
pp.7-8). 

9.  For  example,  using  a  sample  of  155 
contracts  and  an  alpha  of  5  percent, 
Christensen  and  Heise  reported  that 
the  cumulative  CPI  does  not  change 
by  more  than  10  percent  from  its  value 
at  the  20  percent  completion  point. 
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10.  An  unfavorable  schedule  variance 
does  not  necessarily  imply  that  work 

,  is  behind  schedule.  By  itself,  the  SPI 
reveals  no  critical  path  information. 
The  SPI  should  be  used  in  conjunc¬ 
tion  with  other  schedule  information 
(Fleming,  1992). 

11.  Christensen  et  al.  (1995)  reviewed  25 
studies  that  compared  the  accuracy  of 
dozens  of  EAC  formulas.  The  most 
accurate  formulas  used  the  CPI,  the 
SPI,  or  the  CPI  x  SPI  as  the  perfor¬ 
mance  factor.  In  addition,  defense 


manuals  that  describe  the  EAC  calcu¬ 
lation,  and  standard  DoD  CPR  analy¬ 
sis  software,  invariably  include  these 
index-based  formulas  as  standard  op¬ 
tions  in  computing  the  EAC.  Because 
cost  and  schedule  problems  can  drive 
future  costs,  using  both  CPI  and  the 
SPI  in  the  performance  factor  is  popu¬ 
lar.  Multiplying  the  CPI  by  the  SPI  is 
a  crude  but  simple  attempt  to  adjust 
the  CPI  by  the  adverse  influence  that 
schedule  problems  can  have  on  cost 
growth. 


295 


Acquisition  Review  Quarterly— Summer  1999 


296 


